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ABSTRACT 

A common problem in the behavioral sciencies is to 
determine if a set of observed variabiles can be more parsimoniously 
represented by a smaller set of derived variables. To address this 
problem, the performance, of five^ methods for determining the number 
of components to retain (Horn's parallel analysis7 Velicer ' s rlinimum 
Average Partial (MAP), Cattail's SCREE, Bartlett ' a- Chi~Sgu;ire. testi 
and Kaiser's eigenvalue greater than unity rule) was investigated 
across seven systematically varied factors (sample size, number of 
variables, number of components, component saturation, equal or 
unequal numbeirs of varikbles per component, and the presence 6r . 
absence of unique and complex variables). Five sample cosrelation 
matrices were generated at each of two levels of sample size from the 
48 known population correlation matrices representing six levels of 
component pattern complexity. ,The performances of the parallel, 
analysis and the MAP methods were generally the best across all 
situations. The SCREE test was generally accurate but variable. 
Barl^lett * s-test was less accurate alod mor^ variable than the SCREE 
test. Kaiser's method tended to severely overestimate the number of 
components*. Recommendations concerning the conditions under which 
each of the methods are accurate are discussed, along with the most 
effective and useful methods combinations. (Author/BW) 
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ABSTRACT 

s 

The performance of flw n»thods for determining the number of components ^to 
retain (Horn's parallel a^V^ls. Vellcer's MAP. CattelVs SCREE. Bartletf i 
Chi -Square test and Kaiser's eigenvalue greatier than unity rule) was 
Investigated across seven systematically varied factors (san^le size, number 
of variables, number of coi^onents, coipponent saturation, equal or.unequa^ 
numbers of variables per component, and the presence or absence of unique and 
complex variables). Five saii^ile correlation matrices were^ generated at each 
of two levels of sample size from the 48 known population correlation matrices 
representing six levels of con^onent pattern complexity. The performance of 
the parallel analysis and the MAP methods was generally the. best across all 
situations. The SCREE test was generally accurate but variable. Bartlett's 
test was less accurate and more variable thfin the SCREE test. Kaiser's method 
tended to sev^ely overestimate the number of components. Recorou»ndat1ons 
concerning the conditions under which each of the methods are accurate are 
discussed, along with the Bost effective and useful methods combinations. 
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^ A CoiapaHson of Five Rules for Oetormlning the 
> • ■ 

number of Components In Complex Data -Sets 

A comon prob1e» In the b»h«v1of«1 science* 1» to deteralne If a set of p 
observed variables carl be more parslnonlously represented by * smaller set of 
m derived variables. Component analysis and factor analysis represent two 
broad classes of procedures designed to solve this problem. The purpose of 
the analysis may Involve the ca.lculat1on of n scores to replace the orlslnal p 
observations for 'each subject or the'lnt^retatlon 6t the pxn pattern matrix. 
A. which provides Infonwtlon for the understanding and interpretation of the 
"original variables. The researchers employing parsimony procedures imist.make 
a number of decisions. Including chilce of method, choice of rotation, and 
choice of method of Calculating the scores. " One of the most critical 
decisions Is determining how many factors or cowonents to,ret.1n-(m). The 
present paper presents the results of a Monte Carlo evaluation of five 
alternative methods that have been proposed for determining the value of m; 

The determination of the mimber of components or factors to retain Is 
likely to be the most Important declsloh a researcher will Ake. . Decisions 
Involving choice of method, type of rotation, and type of score will have 
relatively less Impact because of the deiwnstrated robustness of results 
across different alternatives In these areas. However, under- or 
over-extraction will distort the resum. The obvious problem of 

underextractlon Involves th^ loss of In^qrtant Infbrraatlon by ignoring a 



factor or coining It with another factor. The effects of overextractio'.. 
followtd by rotation. Is less well doctumented but equally Important. Corarey 
(1978) describes- some of the dangers, such as ^Inor factors being built up at 
the expense of major factors and/or the creation of factors with only one high' 
loading and a few low loadings. These are factors that are botr| unlikely to 
replicate and will be unlnterpretable. Vellcer and Jackson ( 198^1 assert that 
overextractlon, Is, likely to be the prime rcson fpr discrepancies between 
factor analysis and component analysis. In view of how Important this 
decision Is to the analysts, it Is Interesting that sor^ recent textbooks 
provide little or no gqldance In this area (Chatfleld 4 Collins, 1980; 
Jackson, 1983; and Lunnet)org & Abbott, 1983). - ^' 

Principal Component Analysis (PCA; Hotel ling, 1933) may be viewed as 
Involving ah el gen decon^osltlon of the P x P sample correlation matrix^, 
where , . 

[1] R « L'D^L . 

0^ Is the P x P diagonal matrix containing, the elgen roots of R and L is- a P 
X P matrix which contains the corresponding figen vectors. ' When component 
analysis Is employed as a par&lm^ny model, only the first m components are 
retained. The component pattern (A) may be written as 

« 

Where contains the first a elgen rpots andj.^ contains the 
corresponding first m elgen vectors. Glass and Taylor .(1966), Pruzek and 
r*ab1now1tz*(1981), and Kaiser (1970) hav»e reported on the widespread use of 
PCA in this manner. Vellcer (1974, 1976^1977) and Vellcer, Peacock and 
Jackson (1982) have shown this use of ?CA and Factor Analysis result In 
essentially equivalent solutions^ 



A secondtlass of procedures, caned'coRiBon factor analysis (CFA) has also 
been employed to express a set of P variables more parslmonlousjiir as a smaljer 
set. The factor analytic model' specifics that a P x P correlation (pr 
covarlanpe) matrix may be accounted for by m coiason and P unique factors. 
This model may be expr*essed as' r 

[33 . . R « A A' + U2 V ' • . . , 

Where -A Is a P it m pattern matrix and Isth^ P x P diagonal matrix of 
weights for the unique factors.- ^t Is Important to note that m Is frequently 
assumed to be known for the derivation of these^f actor, analysis procedures. 
Sometimes the maximum likelihood test Is en^loyed to test If the assumed 
number of factors Is correct. ^ * 

Since both CFA and PCA are employed as data reduction techniques. It Is 
Important to note s^me <J1 fferences between them. The CFA approach requires ^ 
that ra, the dimension of the reduced set of variables, be known prior to the 
analysis. The value of m may be &term^ned In one of two general ways. In « 
one approach, m may be determined by applying some iwhtod to a PCA solution 
and the result then^used In the factor analysis solution. A second approach 
uses a maximum likelihood test to evaluate, the fit for different values of ra. 
Unfortunately, many of the methods applied to tti^ Pck solution provide 
different results from each othe/and from the maxl^m likelihood approach. 
Further, Jackson and Cjhan (198(/) have discussed nui»rous cof^utatlonaV 
difficulties with the maxirmim likelihood approach Itself. In addition, an 
Indeterminacy has been Identified in the simultaneous estimation of A and 
(Guttman,4954; ^chonemann & Wang, 1972; Steig^ & Schonemann, 1979). This 
Indeterminacy is InherentMn the factor analysis model. In light of 
difficulties associated with the requirement that m be known ^ priori, the 
indeterminacy of ^e factor model, the computation problems witti factor 



analysis, the widespread use of PCA. and the general comparability of results, 
across the two methods, this* study chose to focus on the PCA procedure.^ 



• . Properties of Retained Components 

The comparison of methods to determine the nui^er of components to Vetaln 
requires a descrfptlon of the qualities oesirable In a retained cofi^onent. A 
review of the properties of principal con^onentSj linked with the goal of data 
sumraarlzatlon, provides such a discrlptlon. 

Number of substantial Ibadlngs, Intuitively, a parsimony application of 
PCA requires each retained component to .con.ta1n at least two substantial 
i loadings. Sunuiarlzlng power Is lost when only one variable Is represented. 
Algebraic (Anderson & Rubin, and statistical (iawley, 1940, Morrison, 

1976) examinations of CFA agree that «t least three Variables are requ-lred 
before the first factor can bejdentlfled/ Anderson and Rubin (1956) have 
f\jrther demonstrated that each subsequent Identifiable factor naist contain at 
least three non-zero loadings. At a sample level, a mlnlimira of at Mast three 
significant loadings are required for factor Identification. 

VatMance ac^ounted for.^ P«1nc1pal c^^«irients analysis proceeds from 'I 
correlation mxrU, a standardized variance- covarlance matrix in which the 
variance of each original variable Is equal to 1.0. The variance of each 
principal component Is equal to tho eigenvalue of that component. The sum, of 
all P eigenvalues Is equa> to the number of variables, a i.o oi^envaiuo 

component, .urcounts for as much varlanco as a sinRle variable. 

Components with eigenvalues near zero provide no summarizing power. A 
component with an eigenvalue greater than 1.0 provides more summarizing power| 
than an original variable. 
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addressed the Issue of coi^onent reliability. Noting that a component must be 
reliable to be usjsful, K*1ser (1960) argued that the irel lability of a 
component, will always be non-negative when the eigenvalue exceeds 1.0. Horn 
(1969) noted that this approach to reliability Includes all P variables 
regard! ess^ of *the1 r component 1 oadi ngs. In appl 1 ed usage , component scpres 
are usually generated as an unweighted suid of those variables with substantial 
component loadings. Reliability estimates based only on those flems 
coatrlbuting to the component score can be quite high even when the cwiponent 
eigenvalue Is below 1.0 (Horn, ,1969). ; 

The component properties reviewed above can be Integrated to pre- - 
sent an oi»erat1onal definition of a useful coraponfent. Conventional use of PCA 
as a data reduction technique, combined with algebraic and statistical <4 
necessity In CFA dictate that, at the popHlatlon level, at least three . 
non-zero loadings are required to Identify a useful coaqjoneiM:. At the sample 
level, three significant and substantial Ir^^dlngs are needed., I/J order to 
guarantee non-negatlve component reliability, retained components are required 
to have «n eigenvalue greater than 1,0? Therefore, all* con^onents with three 
or more substantial loadings and an eigenvalue of greater than 1,0 will be 
referred to as. major (^u^onents (JWO. Such MJC components would probably be 
•of Interest to Rwst Investigators. Coi^onents which have either (1) less than 
three substantial loadings but an eigenvalue of 1.0 or greater or (2) ^ 
components which have more than three substantial leadings but an eigenvalue 
of less than 1.0 may be of Interest to some Investlialors and will be referred 
to as minor (I^C) cownents. Finally, co«^onents with both less than three 
substantial loadings and an eigenvalue less than 1.0 should never be retained 
and will be referred to as trivial (TC) coii«)onents. Table 1 summarizes these 
operational definitions of major, minor and trivial (r«C, HNC, TC) components. 
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Insert Table 1 About Here 



Petermlnlnq the Hurober of Cbroonents 

A nundje^ of rules have ^en suggested to determine the appropriate number 
of coi»9)onents tcT^ retain (Bartlett. 1959, 1961; Cattell, 1966; Crawford, 1975; 
Everett, 1983; Horn, 1965; Joreskog, 1962; Kaiser, 1960; Revelle & Rocklln, 
1979; Veldroan, 1974; Vellcer, 1976b). These rules often do not give the same 
results (Anderson, Aclto & Lee, 1982; Cattell^ Yogelawn, 1977; Hakstlan, 
Rogers « Cattell, 1982; Horn, 1965; Linn. 1968; Zwick & Vellcer, 1982). 
Applied researchers ire, therefore; often at a loss as to how io proceed. 
Conflicting research conclusions can be traced to differing methods of 
defining the correct number of. components. 

This .'section will describe the five methods to be evaluated In this 
study^ The metho^Tare: 1) the Bartle'et test; 2) the eigenvalue greater than 
1.0 rule; 3) the minimum aver^age partial rule; 4) the scree test and 5) the 
parallel analysis method. I'here methods were selected for Inclusion either 
because of their widespread use or their extensive theoretical justi fixation. 
^ Bartlett'i tes t (BART). Following Lawley's (1940, 1941) test for raaxlnaim 
likelihood factor ana^s, Bartlett (1950, 1951) developed an analagous 

» 

statistical test for cor^onent analysis of the .null hypothesis that the 
remaining P-m eigenvalues are equal. Each eigenvalue Is excluded sfquei^lally 
until m approximate chl-square test of the null hypothesis of equality falls 
to be rejected. The first m excluded components are r^alned) 

BART appears sensitive to the sai^le slze.^ Oorsuch (1973) argued that as 
the nun&er Increase*, the tests of s1gn1f1)»^e beco^ more powerful an<l, V 



therefore. 1es» t«i less substantial differences between eigenvalues are found 
to be significant, this can potentially lead to the retention i*re 
components as' a function of the number of subjects. In response to this. Horn 
and Engstrom (1979) have suggested changing the flph* level at different 
levels pf H. Hov«er?er. as the sa«ipl# sUe Iwiteases. the estimates of 
population elgenvalues.wni become. Increasingly accurate.. This Increased ^ 
accuracy leads to' smaller observed .differences between equal ^genvalues. 
Wis increased acouracy.ww appropriately offset"^ increased ^ower of the 
Bartlett test.tihen the population eigenvalues are actually equal. Zwick and 
Velicer (1982) found the BART test somewhat more accurate with l^rge samples 
than (»1th small samples. ■ -s. 

, ri^^nyalue greater than ^.o m) . Perh«ps the most popular, certainly the 
most co«»nly imploded Wtt^O."*? ^f^" components with eigenvalues 
sreaur than 1.0. Kaiser \vm developed the raWonale for this method based 
on arguments focusing on co^onelit .rel lability, patttrn meaningful ness and ^ 
Guttman's 1954) Wortt examining the lower, bounds for .the number of components 
in image analy'sfT" Gorsuch (1974) noted that many users follow Kaiser (1?60) 
and employ the Kl rule to- determine the number of coin)onent$~4^«(«r than as a 
lower bound as originally presfnted. Difficulties associated with this use 
are noted by Mote (1970) and Humpreys (1964) who argued that rotation of a 
•greater nurter-of components resujted i^n more meaningful sol^itions. They 
1iH)1y the relatively blind use of the Kl rule may sometimes lead to' the 

. ^retention of too few components. 

A nua*er of researchers (Browne. 1968:.Cattell t Jaspers. 1967: Horn. 
1965: Lee » Comrey. 1979; Linn. 1963; Ravelle » Rocklln. 1979; Yeomans * 
GoWe'r. 1982; Z^ck 1 Vellcei;, 1982) however, have found the number of 
components reuined by this method often overestimates th6 known underlying 

■ • . - ^ 
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consponent stnicture. Sorsuch (1974) and Kalsif (1960) rtpoft tne nusaber of 
components retained by Kl *Js coamonly between one tbifd ^d one fifth or one 

« 

sixth the nuwber of variables Included In the correlation matrix. A Monte 
Carlo study by Zwick and Vellcer (1982) suppo'^s this result. This 
relationship of retained co^onents to the nuaa>er of variables Is detrimental 
to the accurate estimation of the underlying con^o*»ent structure. The Kl 
method, although co^nly used. Is believed by some qrltlcs to sometimes 
underestimate and. by many others to grossly overestimate the nqr^er of 
components. The .Tatter situation occurs particularly when there are a large 
(e.g., P greater than 50) nui^er of variables Involved. ^ • 
,. The fflnlmum average parti aV (MAP). Vellcer (1976b) has suggested a method 
based on the matrix of partial correlations. The average of the squared 
partial correlation Is, calculated after each of the m components has been 
parti aled out. Where the minimum average squared paHlal correlation Is 

reached, no further Components are extracted and ptaced. The average squared 

liartlal correlation ifeaches a minimum when the re$1dual matrix most closely 
resembles an (Identity matrix. After that point, the average squared partial 

win Increase: Using this rule, two variables ^ould be expected to 

have high loading^ on each reta1ne<| cosi^onent. The i^thod U-congruent with 
the factor analytic concept of "cooiaon" factors. Vel,1cer (1976b) jJoJnts out 
the method Is' exact, can beapplled with any covarlamce matrix and Is 
logically relajHsd to the'ctincept of factors as representing more than one 
variable. In a recent study (Zwlck « Vellcer, 1982), the MAP rule was more* 
accurate In Identifying a« known tmtoer of coi^onents than either the Kl or . 
BART Ale. " 

The SCREE te^t . Cattell (1966) described t|l8 rule which Is based upon a 
graph of the eigenvalues. The scree test (SCREE) Is sln^^le to apply. The 
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eigenvalues are plotted,/* straight line Is fit through th^'P-ni smaller values 
and those falling ab#d theilln© are retained! A number of complications may 
oc(^ur Including': (1) gradual slop© from.lower to higher^ eigenvalues with no 
obvious break point la tt»e line; C2) acr©' than one bree^lt point fn the line; 
and (3) laore than one apparently sulUble Itue way be drawn^hrough the low - 
values. Horn and Engstrow {\97n have jwted the underlying slwIUrlty of the 
logic of Bartlett's'^chl square test and ,the scree wethod. Both tests ar©>' 
based on an analysis (one statistical, the other visual) of the essential 
equality of the "reii»1ntng'*'»eigenvalu^s. 

The scree test has been west effective when strong coa^onents are present 
with little confounding due to error or unique factors. Tucker. Koopjnan and 
Linn (1^9) found the scree test to be corf'ect In 12 of 18 cases. Cliff 
(1970) found It to be accurate ^rtlcularly If questionable coi^onents are 
included. C/ttell and Jaspers (1967) found the test to be correct In 6 of e 
cases, while Cattell and Vogeliaann (1977) reported the test to be accurate 
over 15 systematically differing analyses. Further. Cliff and^Hamburger 
(1967) found more definite breaks with larger (M • 400 vs. M • 100) san^Jle 
sizes and Linn (1968) concurred In this conclusion. Zwick and VellCfer (1.982)' 
found the scree test to be most accurate with" larger samples and strong \ 
components. They foui:d the scree test to be the m%t accurate of four methods 
evaluated across many exaR|>les of matrices of known, non-coiiplex. structure.. 

Use of the scree test always involves ^ssues of Interrater reliability. 
Csttell and Vogelwann (1977) and Zwl^^ and Vellcer (1982) hive reported good 
Interrater reliability among na^ve and among expei^ Judges. However, Crawford 
and KoopiMn (1979) have reported extremely low Interrater reliabilities. The 
circumstances associated with high and low Interrater reliability on the SCREE 
procedure have not been Identified. 
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Parallel analysis (PA). Parallel Analysis (Horn. 1965). Involves a 
cojRparlson of the obtained, real data eigenvalues with the eigenvalues of a 
correlation inatrlx of the same rank and based upon the same number of 
observations but containing only random uncorrelated \^r1ables. This method 
Is an adaptation of the Kl rule, Suttman's (1954) development of upper and 
lower bounds was based upon population values. Horn (1965) noted that, at the 
population level, the eigenvalues of a correlation matrix of uncorrelated 
variables would all be 1.0. When sanqiles are generated based upon such a 
matrix, however, the initial eigenvalues exceed 1.0 while the final 
eigenvalues are below 1.0. Horn (1965) suggested that the eigenvalues of a - 
correlation matrix of P random uncorrelated variables should be contrasted 
with those of the data set In question, based on the same sample size. 
Components of the matrix of interest, which have eigenvalues greater than 
those of the comparison random matrix, would be retained. This approach 
Integrates the reliability and data summarizing emphasis of the population 
based Kl rule without Ignoring the effect of^tt^le^rfze, 

Horn (1965) presented one example of PA In a PCA problem. He recommended 
that the comparison eigenvalues be based upon a number of generated random 
matrices to avoid major sailing errors in the estimation of the eigenvalues. 
Although there has been no published systematic examination of the PA method 
with PCA, Richraan (personal comrwini cation, Oct.. 14, 1983) reported a series 
of simulation studies with the method. PA was found to be very acci/ate when 
applied to correlation matricies conforming to the formal factor aa&lytic 
model. He further reported that PA led to retention of too many coi^onents 
when applied to correlation matricies conforming t^o the middle nwdel described 
by Tucker, Koopman, and Linn (1969). The method was more accurate In both 
cases at largerHH,* 500) than at smaller (N « 100) sample sizes. 

ERIC ' 13 



Humphreys and Montlnelli (1975) applied PA to principal axis factor 
analysis and found the method accurate over a range of examples. Monti nel 11 
and Hui^hreys (1976) developed a regression equation which accurately predicts 
the eigenvalues of randwi correlation matrices with squared multiple 
correlations Inserted as the diagonil. Sreen (1983) utilized this prediction 
equation to evaluate the performance of factor analysis of binary Items. Mo- 
such prediction equation has been reported for standard correlation matrices. ' 
Variables Affecting Decision Methods 

Previously reported research findings on the performance of the decision 
methods described above Indicate that each may be affected by a set of 
different factors. These factors Include sample size, the number of 
variables, component saturat^'>n, component Identification and the presence of 
special types of variables. This study attempted to incprporate each of these 
influen<|es Into a simulation study. Some of the considerations related to 
each of these factors are presented in thi^section. 

Sample size. Depending upon the decision method employed, it is possible 
that the >)umber of subjects may affect the accuracy of the decision about the 
number of components to retain. Sample size Is typically determined both by 
practical, applied considerations and the need for accurate estimation. The 
sample size jlwst be large enough to allow an adequate estimation of the 
relationships between the variables. On the other hand, in applied settings, 
large Samples may be too expensive to be practical. 

Number of variables. With the developi^nt of coi^uter technology and 
software, larger and larger correlation matrices have been submitted to PCA. 
PCAs of personality inventories at the item level, for Instance, often Involve 
80 to 100 variables. Analysis of 200 variable sets is becoming common. 
Larger nur^ers of variables have been reported to increase the accuracy of 
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some rules while decreasing It for others (Zwl^k 4 Yellcer, 1982). 

Component saturation, Unn (1968) and Z^ck and Vellcer (1982) have 
demonstrated that the underlying co««>onent saturation affects decision 
methods. Underlying coa^onents made up exclusively of high loadings (e^g., 
.80) were more likely to be retained, by various decision methods, than 
components exclusively made up of lower loadings (e.g., .40). 

Component Identification. The accurate Identification of a coi^onent may - 
[depend upon the number of variables which have non-zero loadings on that 
component. Components defined by l.ess u.ian jthree variables are not capable of 
Identification. Th*^ Intact of unequal numbers of variables per component 1s^ 
unclear for any of the rules under discussion. 

Special variables . CcHi^lex variables have a nonzero loading on more than 
one convonent. Unique variables have only one non-zero loading and no other 
variable loads substantially on the same component. Cor^onent patterns 
containing both complex and unique variables are believed to occur frequently 
In applied situations (Tucker et al. 1969). The effect of these types of 
variables upon the various decision rules Is unclear. Complex or unique 
variables r«n be expected to lead to the retention of i»re components by Kl 
and BART and to make SCREE decisions more difficult. The effect of such 
variables upon MAP and PA has not yet been exam1n,ed empirically. 

Methods To Be Included 

The correct determination of the number of con^onents has been Identified 
as a crucial step In the data reduction application of PCA. There continues 
to be general d1sagreei»nt concerning the best i^thod to acco^llsh this 
step. This study coheres the perforoance of five decision nathods on 
simulated data sets,;^ These sets Incorporate variables expected to Influence^/ 
each method. The Kl. method was Included' because It is so widely used. The 
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m method was Included because of Its una^lguous solution. Its relation to 
"conroon factor" concepts and Its good perf onaance' 1 n a recent study (Zwlclc ** 
Vellcer, 1982). Bartletfs statistical lethod (BART) was Included because It 
is the only statistical «ethod appropriate for PCA solutions. The scree test 
(SCREE) wtis Included because of 1>s apparent si «pH city and Its reported 
validity. The parallel analysis; isethod (PA) was Included because of Its 
unambiguous solution and Its reported accuracy. Each of the chosen methods 
may be differentially affected by the manipulated variable^. 

Including saoqjle size, the nui^er of variables, the degree of 
coJponent Identification and saturation, and the presence of unique or complex 
variables. The robustness of the five rules In question, across these 
variables. Is the central focus of tH-1s study. 

^tethod 

ft 

Method of Data Generation 

Studies of the effectlveness of^ftr^r+ous decision wethods may be 
categorized Into one of two types. Historically, the wore cosawn type of 
study employed real data representing either new work or "classic" data sets. 
These studies employed some logical criteria coiwerning the appropriate number 
of components and compared the perfonaance of the proposed decision method to 
the logically determined value (e.g., Cattell, 1966j Horn. 1 965 i Humphreys ft 
Montanelli, 1975; Vellcer, 1976). Such studies, in ef^loying an arbitrary 
logical criterion, may have Inaccurately estimated the performance of the 
decision wlthod in question. More recently, studies of decision rule 
effectiveness have employed correlation matrices generated from cot^onent 
structures entirely under the control of the investigator (e.g., Anderson, 
Aclto & Lee. 1982; Cattell & Vogelman, 1977; Tucker, Koopman ft Linn, 1969; 
Zwick & Vellcer, 1982). These studies have the advantage of a known criterion 



against which, to taeasure the perfonsance of the decision methods. They are, 
however, open to the criticism that the generated matrices, although 
confonalng to a mathematical model, may not represent real data and thus lead 
to Inappropriate conclusions (Tucker, Koopman & Uinn, 1969). 

The question of a rule's accuracy cannot be ex^lned without a known 
criterion. Although logical arguments can be mounted to defend the number of 
components present In some data sets, these arguments are always open to 
question.' Far the assessment of the Impact of various conditions upon a 
rule's accuracy, generated data of a known nuiaber of caaponents Is 
preferable. The Issue of general 1 rati on to real data sets 1$ an ln^brtant but 
separate tssue which may be In^'ipendently addressed In the particular way the 
data Is generated. This study ei^loyed an approach similar to the "middle 
model" of Tucker, Koopman and Linn (1969). 
Procedure 

The number of variables (P) to be employed was set at 36 and 72. These 
values represent small and moderately large data sets and accommodate 
constraints^ Boosed by the selection of the nur^er of coim)onents to be 
Included. Larger Ws of variables have been shown to have a p tlve Intact 
on MAP, BART (Zwick 4 Yellcer, 1982) and SCREE (Cattell « Vogelman, 1982) and 
a negative 1ii«)act on Kl (Zwick & Yellcer, 1982). 

The sample sizes (M) chosen were selected to reflect common, applied 
usage. They were set as a function of the number of variables. The lower N 
was set at twice the number of variables. The higher N was set at five times 
the number of variables. The resulting M's were 72 and 180 In the cases 
Including 36 variables. When 72 variable cases were examined, M's of 144 and 
360 were selected. Theses appear to Include a representative range of sarnie 
sUes as reported In applied educational and psychological research. Larger 
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sample sizes have been shown to oioderately Improve the performance of the MAP, 
SCREE and Kl methods (Cattell I Vogelwan, 1977; Zwick & Vellcer, 1982) ^nd to 
sometimes Improve and sawtlmes weaken the accuracy of the BART method" 
(Sorsuch, 1976; Zwick A Vellcer,. 1982^ 

As described above,, major co^onents (mC) are defined as those with three 
or more substantial loading and an eigenvalue gwter than, 1-0, Two types of 
minor components (MNC) are define!; First, those with three or more ' 
Wtantlal loadings and an eigenvalue of less than 1.0, Second, those with 
less than three substantial loading and an eigenvalue greater than or equal to 
V.O, THvlal components (TO are defined as those with less than three 
substantial loadings and an eigenvalue of less than 1.0. ^ 

The number of liajor coa^onents built Into the population cortelatlon 
matrix was 3 and 6 when P was equal to 36, and 6 and 9 when P was equal to 
72. These values were chosen to reflect a reasonable range of reported 
applied usage. They permit a span of an average number of variables per WC 
(P/MJC) from 6 to 12. Although this P/MJC Is somewhat high, such values arl^ 
required to permit varlabllW In the nui^er of variables per component, while 

still meeting the constraint of at least 3 substantial loadings in each MJC. 

The distribution of P/MJe was constrained to be eljher an equal number of 
variables per MJC or an unequal number. For the cases where an unequal number 
existed, the number was symmetrically distributed about the mean nun&er of 
variables per »3C appropriate for that matrix. That Is, If f were 36, and m 
were 6, the average number of variables per mz would be 6. When P/WO was 
planned to be unequal, the nua^er of variables per coa^nent was 8, 7, 6, 6, 
5. and 4. Similar distributions for other combinations of P and m are 
presented in Table 2. 
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Insert Tabid Z about tiere 

CoR^onont saturation (SAT)» the Magnitude of the loading of the variables 
on a MJC, was split between a high of .8 and a low of .S. These values bridge 
much of the applied range and have been shown (Zwick ft Vellcer, 1982) to 
differentially affect four of the decision rules, under consideration. Mithin 
any one matrix, the coaq)onent loadings on all major components were equal and 
either high (.8) or low (.S). 

♦ » r ■ 

I 

For the purposes of this study* unique variables (UNIQ) were defined as 
variables which do not load at all on either MJC*s or TC*s In the- population 
structure. Inst^d, UNIQ variables'^ represent the only variable loading on one 
type of MNC. Such an MNC h^^ a population eigenvalue of 1.0. Con^lex 
variables are defined here as those variables which load substantially on a 
NilC but also load minimally (.2) on a second type of MNC In the population 
structure. 

Specific combinations of these variables were constructed. Previous work 
has Indicated that N, P and SAT have an Impact upon some of the decision 
Yules. At each level of P and SAT, component patterns were constructed to 
evaluate the Impact of N, P/MJC a number of combinations of factors. A 
"Best Case" set was defined for comparison purposes. This first level of 
complexity (1) had an equal number of variables per major coiiponent, no MNC s 
or TC's present and .thus no coo^lex or UNIQ variables. Five other levels of 
structural coii^lexlty were created for comparison to the "Best Case". This 
was done by (2) Including complex variables to create the l®<C's,. (3) letting 
the number of variables per MJC become unequal, (4) Including unique varir 

V 

ables (as many as the number of MJC^s) to provide the second type of MNC, (5) 
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• Including unique and complex variables together to provl'de MNC's, and,^ 
flnallyi (6) a level was constructed tmich Included unequal number of 
variables per major component and both complex and unique variables. The 
fifth and sixth levels of complexity were included to highlight the possible 
/■ Importance of the^very common situation of Unequal nuiid>ers of vaHables per 

Data Generation 

Population correlatlojL matrices were created for each cob^I nation of the 6 
(Coiriplexlty) x 2 (P) x 2 (SAT) x 2 (m) factors outlined above. Each 
population correlation matrix was "determined as follows: 
One appropriate population coi^onent pattern (A). was created In accordance 
with the level of the number oip variables factor (P), the level of the 
saturation f^tor (SAT), the Idvel of; the number of co^nents factor (m) and 
the level of the cor^lexlty factor under consideration. Post-multiplying by 
Its tran8pos? (AA') resulted In a matrix R* (R* • AA'). Substitution of ones 
In the diagonal of R* Introduced error and produced a population correlation 
matrix R (R ■ R* D^). The introduction of ones In the diagonal of R 
raised It to full rank, allowing subsequent analysis. Five sample correlation 
matrices were generated based on each of these population cornelatlon matrices 
(Montanelll, 1975) at each level of the mfiaber of observations (N) factor. 

Principal co^onent analysis was then performed on each of the resulting 
480 (6 x 2 X 2 x 2 X 2 x 5) sample correlatloij^matrlces. At the time this 
analysis was performed, the number of components to be retained by each of the 
four calculable rules (Kl, MAP, PA and BART) was determined. Horn and 
Engstrom (1979) have suggested that the alpha level of the BART procedure 
should be adjusted to compensate for the Increased sensitivity of the test 
with large senile sixes. Three alpha levels were selected for use with the 
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BART In this study to Incorporate Horn and Englstoiii's (1979) recommendation. 
The^artlett tests were therefore perfonaed at alpha levels of .05 (BA), .001 
(BB) and .0005 |BC) In all caseT. The PA decision was based on the laean 
eigenvalues of 50 random correlation matrices at each level of P and 
• The SCREE test was performed on coi^uter generated plots of the 
e^lgenvalues ^ each of the 480 matrices. These plots were examined by two 
raters trained In t^ SCREE method (Cattell and Vogelman, 1977). The two 
raters were college graduates who had najored In psychology. Although they 
were trained In the SCRIIE procedure they were uninformed of Its purpose. The 
raters were also naive to the exact purpose of the experlB«nt and had no prior 
applied experience with the SCREE test. The graphs were presented to the 
raters In different mixed orders. If either rater asked a question about a 
particular plot, both listened to an explanation based on the Instructions 
given by Cattell a|id Yogelman (1977). wrisnever possible, exan^les from the 
Cattell and Yogelman (1977) directions were used to clarify questions. 
Independently, an experienced expert Judge, uninformed ^s to the details of 
the experiment but fully familiar with the use of the SCREE test, rated one 
sample from each of the 96 cells. 

The judgment required by the SCREE method raises the question of rater ^ 
reliability. Table 3 presents the Inttrrater reliability extlmates of the 
mean of the raters' decisions corrected for the nuB^er of raters. The 
reliability estimates are presented at each level of con^lexlty, saturation 
and the nun*er of variables. The reliability estimates ranged from .61 to 
1.00 with a median value of approximately .88. 



Insert Table 3 about here 
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The correlations of the mean of the raters decisions with the expert's 
I judgment ranged from ,60 to ,90 across the 6 levels of complexity. The median 
and mean (Flsh^^J transfonaed) correlation of the averaged. rater's decision 
with the expert's judg^nt were both approximately ,80. 

Si ' . . 

Results 

' Each decision method leads to an estimate of the number of major 
components (MJC) to retain. The ^difference between these rule determined 
estimates of MJC (RMJC) and the known population value of the number of WC's 
(pAjC) was the primary .dependent jfarl able In this study. This difference was 
( computed as d » RW3C --PWC, The mean difference from the criteria Is an 
estimate of the method's accuracy. Positive d's, therefore. Indicate 
overestlmatlons while negative d's Indicate underestlmatlons. A difference of 
0 indicates a correct estimation of MJC. "Phe standard deviation of the 
difference Is an Indication of the ^thods' consistency. Smaller standard 
deviations Indicate more consistent estimates of MJC, The mean and standard 
deviation of d for each ^thod, under various conditions, are presented below. 

TJfe results are alternately presented first for the P « 36 cases and then. 
In a parallel fashion, for the P • 72 cases. Each level of sample^lze 
(Tables 4 and 5), nus&er of variables per major coa^onent (Tables 6 and 7) and 
pattern con^lexlty (Tables 8, 9, 10 and 11) will be summarized within each 
level of P and SAT. Tables 12 and 13 present the proportion of each method's 
estimates of MJC which deviated a set amount from the population value. This 
representation of the distribution of the estimates is also presented at each 

level of P and SAT. 

Table 4 presents the means (dV and standard deviations (sd) of the 
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difference between each taethod's esifiaate^of MJC and the known MJC for 
different sainple sUes when P « 36 and the component saturation Is .5 and .8 
Table 4, therefore, sunBaarUe*- results colURsed across all six levels of 
pattern complexity and both levels of the nui^er of variables per MJC In order 
to allow an examlnatiotj, of the Individual Impact of sample sl2fe. Each of the 
four rows of differences In Table 4 represent 60 observations. Tables 4 
through 11 follow essentially the same format. A detailed description will, 
therefore, be given only for Ta^e 4. 

The! first row of Table 4 presents the mean difference of each method's 
estimate of MJC from the known value when P was 36, the saturation was, .5 and 
the sample size was 72. Under these conditions, the MAP method produced a | 
mean difference score (d) of -1.08, an^nderestlmatlon. The PA «»thod 
produced 'a r.4JCh smaller underesti matron of -O.OS. Tt^ SCREE (0.50) and K1 
(8.32) methods both overestimated the criterion with Kl providing a. very large 
overestlmatlon. The results given by the Bartlett method were calculated for 
alpha levels of .05, .001 and .0005, as Indicated above. At eacH level, the 
Bartlett method led to underestlmatlons (-2.87^ -3.92, -3.98 respectively). 
The Bartlett method retained fewer components at the more conservative aiphii 

levels. The 8t;>ndnrd dcvtntlonH (sd's) 

associate with the mearj difference scores for each method are presented In 
row 2. They ranged from 0.:0 for the PA method to 1.68 for the MAP method. 
The third and fourth rows of Table 4 present the eiaan difference of each 
method's estimate of MJC from the known value and the star^dard deviations when 
P was 36, the saturation was .5 and the sample, size was 18©. The liwrease In 
M from 72 to 180 appeared to have had minor effects on the MAP; PA and SCREE 
methods. The Kl and BART methods show some, l^rov^rtt at Ve^ higher level of 
M, Rows 5 and 6 of Table 4 present the msan differences and stand vd 
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deviations for each inethod when P was 36, the saturation was .8 and the sample 
size was 72, All the. methods showe<( li^roved average esi^l mates of the 
fccHerlon at th1is\lgher level of saturation, ^.t should be notid, however, 
that the standard devlatl'on of the differences Increased for all levels of the 
BART method^andv^o a^essir extent, for the Kl rule as well. Rows 7 and 8^ of 
Table 4 present the mean differences a^d stanjlard deviations for each method 
when the sample size was Increased to 180, P was 36 and the saturation was 
.8. Compared to the results In rows .5 and 6^ the larger sample size resttVted 
in more accurate W • 0.0) and consistent (sd • 0.0) estimations by f? and PA 
methods, fhe performance of the SCREE and Kl method was not greatly 
affected. The thr^e levels of the BART, method retained more co^onents at the 
higher saii|)le site. ' This led to a larger overestlmatlon at BA.and a switch 
from under- to overestlmatlon at BB and BC. The standard deviations at all- 
three levels of BART Ippear to have been .larger at M -180 than at M « 72. 



Insert Table 4 About Here 



The K^thod performed sVlghtTy better at the higher sas^le sl^e at both 
levels of con^onent saturation. BART retained mre components at the higher 
level of sai^le size at both levels of con^onent saturation. Table 5 
parallels Table 4 with equal to 72. It suraaarlzes the Impact of sai^le sUe 
at both levels of cow^onent saturation. The MAP and PA methods were again 
minimally Influenced by the sample size change at both levels of conq)onent 
saturation. When the saturation was .5, the SCftEE method showed less 
overestlmatlon at the higher than at the lower sample size. This effect was 
not apparent when the saturation was .8. 
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' Insert Table S About Here 

*** « 

The role of the number of variables is presented frqfB a -different 
perspective in Tables 6 and 7, Table 6 presents a suawary of the results for 
each average number of variables per MJC (P/MJC) whenj e*?ualed 36 and the 
saturation was ,5 and .8, At both levels of saturation, MAP, PA and SCREE 
performed raore^ accurately and consistently whtfn the average number of 
variables -per hit increased from 6 to .12, Kl showed an increased 
overestimation when P/MJC Increased and the saturation was ,6 and a decreased 
overestiwation when P/MJC increased and the saturation was .8, Ttie BART 
method consistently showed i decrease in th6 nun&er of components retained as 
P/MJC increased. When the saturation' was .5, this resulted in larger 
underestlmations; while at a saturation of, .8 BART's estimates changed from 
overestlmatlpns to underestlmations as P/MJC Increased. 

^ Insert Table 6 About Here 



Table 7 parallels Table 6 with P equal to 72. The MAP, PA and SCREE 
methods showed Improved perfor^nces at the higher level of P/MJC when the 
saturation was .S, When the saturation^ was .8, MAP, ^ and SCREE showed 
essentially no ij^rovement at the higher level of P/MJC. The Kl and BART 
methods showed some.l^rovement at the higher level of P/PWC at both levels of 
saturation. 



Insert Table 7 About Here 
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Tables 8 and f pftsent a sunwary of the lasthods* peffonnance when P was 
gqygl ^ 35 saturation was .5 or •& at each of six levels of pattern 

complexity. The results are colH^sek across both levels of M and P/MJC so 
tnat each level of Complexity repreWits 20 observations. As defined above, 
at Complexity^^el I the MJC's contain equal nuabers of variables. There are 
no unique or complex variables at Coa^lexi^ level 1 and hence no mQ'$ or 
TC's. Level 2 is the same as level 1 except it includes MNC's coiig)rised of 
low coir«)lex loadings. Level 3 is the same as level 1 except the nun^er of 
variables per HJC is unequal across MJC's. Level 4 is the same as level 1 
except it includes MMC!s made up of unique variables. Level 5 coii^ines both 
TC's comprised of complex loadings and JtlC's comprised of unique variables, 
level 6 is the san» as levBlHS AtQept the nun^er ^>f varlbles joading on each 
MJC Is unequal across major con^onents. 

Insert Table 8 and 9 ^bout Here 



The range of pattenMJO^lexity affected the methods differently. 
Although the ruethods tended to perform best at Coi^lexity level 1, they had 
different worst cases. When the saturation was .5, in Table 8, the worst 
cases were: MAP and PA at level 5; SCREE at level 2; Kl and BART at level 4. 
A comparison of Tables 8 and 9 Indicates, MAP, PA, SCREE and Kl showed 
substantial innirovei^nt at all levels of Co^lexlty when the saturation was 
.8. At this saturati^ level, PA slightly underestimated at Complexity level 
6. MAP slightly overestimated at Ca^lexity levels 2, 5 and 6. SCREE 
slightly overestimated at all levels of Complexity and level 6 resulted in Its 
largest overestimation. The BART B»thod overestimated slightly or not at all 
at levels 1, 2 and 3, Kl markedly overtstimated at Co^lexity levels 4, 5 and 
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6 as did BART, Ltvels 4, 5 and 6 all contain unique variables. 

Tables 10 and 11 parallel Tables 8 and 9, with P equal to 72. As was the 
case when P was 36, th^ range of coi^lexlty appears to have differentially 
affected the u^thod's performance. At a saturation of .6, In Table 10, MAP 
was quite accurate at levels 1, 2, 4 and 5 but underestimated erratically at 
levels 3 and 6. At a saturation of .8, In Table 11, MAP was very accurate at 
all levels of coi^lexlty. PA was quite accurate across all levels of 
cowplexlty with laarked Ij^roveiront at the .8 saturation level. At that level, 
PA was always accura^te. Generally, The SCREE method somewhat overestimated at 
( h level of con^lexlty. It performed worst when the saturation was .5 at 
levels 2 and 4 and when the saturation was .8, level 4. The Kl Ji^thod gave 
gross overestimates at all levels of complexity when the saturation was .5. 
It was quite accurate when the saturation was .8 at levels 1, 2 and 3, ^t the 
sam^aturatlon at levels 4, S and 6, the method consistently overestimated 
the criterion. The BART method showed a uwderate range of underestimation 
when the saturation was .S with the worst case appearing to be level 6. When' 
the saturation was .8, BART performed well at levels 1 and 3, overestimated 
fj^derately at level 2 and overestlfiated greatly at levels 4, 5 and 6. 



Insert Tables 10 and 11 About Here 



A general overview of the performance of the different methods may be 
gained by calculating the percent of Jlmes each method's estimate deviated a 
set anwunt from the criterion. Since P and saturation appear to have had the 
most substantial l8|>act on the ^thods. the percentages were cpmputed at each 
level of these variables. Deviations of greater than three were collapsed for 
sln^llclty of presentation. Differences of 0 Indicate accurate estimates. 
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These percentages are presented In Tables 12 and 13, 



Insert Table 12 About Here 



As Table 12 Indicates, at both levels of saturation when P was 36, PA was 
clearly the most frequently accurate method followed by MAP and SCREE. Kl's 
tendency to overestlroate was marked. The Kl method never underestimated. Th( 
BART method was quite Inaccurate and varUble at both levels of saturation. 

Table 13 parallels Table 12 with P equal to 72. Again, PA was the most 
frequer|tly accurate method at both levels of saturation. Both the PA and the 
MAP methods showed ln^roved performance, when P was equal to 72 compared to 
36. The PA and MAP methods were nearly equivalent when the saturation was 
.0. The Kl method showed essentfally the same pattern of results when P was 
72 as at 36 because of attenuated range on these tables. The BART method 
retained more conqjonents when P was 72 than 36. BART was more often accurate 
when the saturation was .5 than .8 when P was 72. 



Insert Table 13 About Hern 



Discussion 

The question of Interest In this study was the ability of five decision 
methods to estimate the number of major co^onents present In the population 
correlation matrices given only the generated senile matrices. The difference 
between^^e estimated nu^er and the defined nui^er of major components served 
as the ^t^Ti dependent variable In this simulation study. The standard 
deviation of the difference scores gave further Information about each 
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method's consistency. Finally, the percent of correct decisions and the 
percent of decisions at specified levels of deviation from the criterion were 
also calculated. 

The five decision rules eiaployed were the eigenvalue greater than one rule 
(Kl), Bartletfs test (BART), the scree test (SCREE), the mlnliwjia average 
partial method (MAP) and the parallel analysis method (PA). The performance 
of the five methods for determining the number of con^onents was examined In 
ten samples drawn from each of 48 simulated population correlation matrices 
over a range of component pattern coirqilexity. The least complex pattern 
replicated earlier work (Zwick & Yellcer, 1982) and included only equal 
numbers of variables per cos^onent and no unique or cor^lex variables. 

^ Component pattern conqjlexlty was varied by modifying this clear, least complex 
case with combinations that Included: (1) complex variables, (2) equal and 
unequal nun^ers of va»*'4bles per coa^onent; and (3) unique variables. The 
resultant six levels of complexity are felt to cover an adequately wide range 
to permit a test of the relative strengths and weaknesses of the decision 
methods examined. Major con^onents (MJC) were defined as those having more 
than three substantial loadings and an eigenvalue greater than or equal to 1.0 
at the population level. Two types of minor cof^onents mO were defined. 
It is felt that these cos^lex patterns expand upon the formal raodel and 
incorporate cases likely to be encountered in real data analyses. 

The Kl rule was found to overestimate, consistently the nua&er of major 
components. It never underestimated. This finding is consistent with those 
of Cattell and Jasper (1967), Linn (1968), Yeomans and Golden (1982) and Zwick 
and Velicer (1982). At a coi^onent saturation of .5, the number retained 

^^errfell in the 1/3 to 1/2 of P range discussed by Gorsuch (1974). As the 
number of variables Increased, so did the nunrtjer of coi^onents retained. Kl 
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reuined wr. conpoifenU when unique v.H.b1e» were Included In the population 
paturn. These findlnss are clearly contrary to those of Humphreys (1964) and 
Mote (1970), who concluded the ICl sethod sonetlne* retained too few 
components. Either their data represented a typ« component conplexlty not 
included in this study or their orlBlnal judjaents of the number of components 
in their data sets were overestimates. Siven the apparent functional 
relationship of the number of components retained by Kl to the number of 
variables and the repeated reports of the method's Inaccuracy, the Kl rule 
cannot be recommended for PCA. 

The results and conclusions about the Kl rule presented here are, 
consistent with both previous empirical studies and the theoretical criticism 
of the method. However, our conclusions are In sharp contrast to many recent 
textbooks where Kl Is either l!he preferred or only method discussed (Aflfl S 
Clark. 1984; Everltt i Dunn. 1983; Johnson » Wchem. 1988; Marascullo »^ 
Levin. 1983; T.fiachn^ck * Fidel! . 1983). For example. Marascullo « levin 
(1983) are typical when they first discuss It with a cautlon-^n most cases. 
Kaiser's rule Is quite workable, but . . . p. 237) but. In a later sun««nr. 
flatly recommend It CU it one. we rwommend.". p. 260). The use of the Kl 
fule as the default value In some of the standard computer packages (8H0P. 
SPSS) represents an 1^1 Idt endorsement of the procedure, particularly with 
naive users. This pattern of explicit endorsement by textbook writers and 
implicit endorsement by coi^uter packages, contrasted with empirical findings 
that the procedure Is very likely to prt>vMe a grossly wrong answer, seems to 
guarantee that » large number of Incorrect findings will continue to be 
reported* 

The BART method's perfonaance was the most variable of those examined. In 
addition to variability, the method was sensitive to a number of Influences. 
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Increases In M, P and SAT as well as the use of conservative alpha levels and 
the presence of unique variables all lead to the retention of .more 
components. The first four of these Influences way be seen as affecting the 
statistical power of the Bartlett test. In data ^lets wher^ the P-ra 
eigenvalues were In fact equal at the population leVel, Zwick and Yellcer 
(1982) found the method to be moderately accurate. In the broader range of 
complexity examined here, the test tended to retain both types of minor 
components defined above. Although examination of different alpha levels led 
to fewer or greater nurjd>ers of compdnents retained, the accuracy and 
consistency of the method did not appear to be markedly Ir^roved by adjusting 

alpha levels with sample size (see Table A) as was suggested by HoVn and Engst 

il979). Other factors present In this study appear to have had a greater 
influence on the performance of BART, across alpha levels, than did sample 
size alone. 

The Bartlett test Is accurate In answering statistical questions 
concerning the equality of eigenvalues {$artlett, 1950; 1951). Researchers 
Inclined to examine minor coa?>onents, particularly early In the course of 
explorator/liilalysis, may find the ii»thod helpful. However, the Bartlett test 
cannot be recommended as a general ii»thod of determining the nu^r of major ~ 
corr^onents to retain. The tendency of the method to retafn both minor and 
trivial components might reflect the basic logic of the test. Only true error 
should be expected to meet the requirement of equal elgen values. However, 
most researchers would not find minor or trivial cof^nents to be consistent 
with their Implicit definition of a factor or coiponent that Is worthy of 
retention. Therefore, the test may work correctly but may not be an 
appropriate test for most applications. 

This study did not Investigate the maxlawm Hlellhood test which assumes 
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th« factor amnysis s»dtl. The raaxliiua llktllhood test Is based on a logic 
identical to the Bartlett test. CraplHcal Investigations have foand the same 
pattern of results with the llkelhood test as Me have reported with the 
Bartlett test (Hakstfan, Rogers. « Catiell. 1982; Ricimn, personal - 
cownunlcatlon). Again, the JroMea way be with an Inappropriate fonmilatlon 
of test, re^ther.than the performance of the test. 

The SCREE method had moderate overall reliability when the mean of two 
trained raters was used. The correlation of the mean of those, raters* 
decisions with an expert Judgejindlcated fair overall agreement. Reports of 
rater reliability on the SCREE have ranged from very good (Cattell and 

9 

Jaspers. 1967) to quite poor (Crawford and Koopman, 1979). This range may 
reflect either the training or the task complexity across research projects. 
The raters In this Study showed gr^at^r agreement at higher than at lower 
component saturation levels. They showed greater^ agreement when there were 
more rather than fewer variables. Perhaps more tmporUntly, the Interrater- 
reliability of the SCREE procedure had a fairly wide range across levels 

V 

of complexity. The moderate reliability of the SCREE method is 

very problematic for the applied researcher.^ Unreliability at this point In 
the analysis may well expose a study to otherwise avoidable experimenter 
bias. In any case, applied researchers should note that reliability questions 
always arise In any use of the SCREE nethod. 

In general, the SCREE wethod was aiore accurate and less variable than 
either the KT or lART method. This method was more accurate and less variable 
at the higher level of component saturation, larger sample sixes also 
Improved Its accuracy when P was 72 and SAT was .6. Sasple siie did not 
appreciably affect SCREE at other levels of P or SAT. This effect of larger 
sample size is consistent with those reported elsewhere (Cliff and Pennell. 
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1967; Linn, 1968; Zwick and Vellcer, 1982), The accuracy of the SCREE method 
was not affecte<UHy an Increase In the number of variables examined. An 
Increase In the average number of var1ables*#6r con^Jonent did not affect the 
method's accuracy. In an earlier study (Zwick and Vellcer, 1982), utilizing 
non-complex matrices, the SCREE method performed better than MAP when the^ , 
major components contained 6 or less variables and the saturation was low. 
This trend can be observed again under awre complex conditions. 

The SCREE method tended to overestimate rather than to underestimate nfhen 
It deviated from the criterion value. As reflected in Tables 12 and 13, the 
' SCREE was accurate about 57% of the time. When the SCREE method was in error, 
90 percent of the errors were overesti mat ions. The SCREE method appeared to 
be most variable at the low level of component saturation or when unique or 
coR^lex variables were present. Nevertheless, even given its variability and 
tenderly toward overestimation, the SCREE method seldom led to the retention 
of more than two components over the criterion value. Many experienced 
Investigators routinely examine 1, 2 or 3 components above and below the 
estimate given by tlwlr favorite decision method. This practice, coupled with 
good Judgment concerning InterpreUbility may often result In appropriate 
solutions when the SCREE Wth^ris e^Voyedr Thrs optimistic assertion 
notwithstanding, the ever present question of rater reliability, the tenderwy 
to overestimate and the apparent Increased variability In the common case of 
unique or con^lex variables all argue against the exclusive use of the SCREE 
method. Siven these drawbacks and the availability of other clearly superior 
methods, SCREE can no longer be recommended as the method of choice for 
determining the nun^er of con^onents in PCA. 

In general, the MAP method was more often accurate and less variable than 
the Kl, BART or SCREE methods. It showed an overall tendency to underestimate 
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the criterion. ^The MAP method was i»st accurate at the higher level of 
component satur^lon or when the average nujaber of variables per component was 
large. Its perl^naance was not markedly Influenced by saii9)1e size within the 
range examined In this study. The MAP method was quite accurate under many 
conditions .and, when accurate, showed little variability. In cases 
repf)«sent:ng both a low level of saturation and a low number of variables per 
component, the MAP method consistently underestimated the number of major 
components. This effect can be most, clearly seen In Table 6 by comparing the 
two levels ofJ»/WC when P - 36 and SAT - .5. Additional Information about 
this effect can be gleaned from Table 7. The MAP method gave larger 
underestimates and displayed greater variability when unique variables were 
present (levels 4, 5 and 6) and when there was an unequal number of variables 
per convonent (level 3 and 6). In this simulation study, unique variables 
reduced the nujirt)er of variables per component by 1. The presence of 
unequal numbers of variables per component Independently reduced the nun^er of 
variables per component on the trailing major components. The presence of 
complex variables (level 2 and i») lowers the major cofiq)onent saturation at the 
sample level. Complex variables thus Independently Increase the effect of low 
component saturation. The coiitf)1 nation of these Influences appears to result 
In components at the senile level which account for less variance than those 
conponents containing only a unique variable. MAP should not retain a unique 
variable component. It, therefore, falls to pick up the less well Identified 
major coii|>onents. 

Overall, the MAP method was accurate more often than were the Kl, BART or 
SCREE methods. The MAP method gave results within If of the criterion 
between 72% (P - 36, SAT - .5) and 100% (P • 36, SAT - .8; P - 72, SAT « .8 
of the time. When it was In error, the MAP method tended to underestimate. 
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Approximately 90% of the MAP errors were underestliaatlons. 

The MAP fliethod provides an unequivocal stopping point. It Is tied to the 
concept of parsimony by directly rejecting coaponents Identified by only one 
vaHable. MAP shoi«d a tendency to underestfiaate the known nu^er of major 
components at the component satuatlon level of .5 when up to six variables 
loaded on a component. It Is quite accurate when component saturation Is high 
or when there is an average of 8 or more variables per con^onent. Researchers 
wishing to Ignore relatively small major congionents should employ MAP as a 
primary method of determining the number of components^ to retain. 

The PA method was consistently accuf'ate. It was typically the n»st 
accurate method at each lev^ of co^lexlty examined. The average deviation 
of PA from the criterion did not exceed exceed 0.3a under any condition 
examined. The difference scores of the PA methcfd showed less variability than 
those of any other rule. Increases in sample size, component saturations and 
P/MJC improved the PA method's performance when there was room for 
improvement. It might have been expected that the PA method would 
overestimate in the preserve of minor components made up of unique or complex 
variables. Some evidence of this is present at P • 72, SAT • .S.^oi^lexity 
levels 2, 4 and 5. This pattern Is not replicated at other levels of SAT or P, 

Overall, the PA method was the most frequently accurate RKithod examined. 
It gave results within ll of the criterion for between 9Bt (P ■ 36, SAT • 
,5) and 100% (P - 36, SAT - .8; P - 72, SAT « .8) of the ca$e« examined. When 
the PA method was in error, it showed a slight tendency toward 
overestimation. Approxiraately 65% of the PA method's errors were 
overektlmations. The accura6y of the PA method in this stu^ is consistent 
with the CFA results reported by Humphreys and Montanelli (1975). 

A major drawback iff the applied use of the PA method is the necessity of 
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generating a large set of random correlation Mtrlces atnhe particular 
conibinatlon of P and M under consideration. The prediction equation developed 
for principal axis factor analysis (Montlnelll fnd Huiaphreys, 1976) is not 
appropriate for principal' coa^onents analysis. . ^ 

In suRwarlzIng the results of the present study It Is useful to postulate 
a further division of the class of con^onent previously labeled as Major 
Component (MJC). Those coapbnent^ which Involve. only a limited number of 
variables and low saturation will be labelled as Poorly Defined Components 
<PDC). Components with either a large number of variables or high Utwratlon 
win be labelled as Well Defined Coa^onents iWSF). Poorly Defined Qoaiionents 
do not possess any "marker- varlbles, i.e., variables with high loadings on 
that component." Investigators typically employ such marker variables as 
defining varlbles In interpreting the co^onent. GuadagnoXi and 
Vellcer (1984) found thatPDC's were unlikely to accurately replicate even In 
fairly large samples. The contolnatlon of the two issues of dffficult . ^ ■ 
Interpretablllty and questionable repflcablllty, make the retention of these 
components problematic. 

The two methods which were the most accurate, MAP and PA, provided 
divergent results primarily when PDC's were present. An A Priori decision 
about whether or not to attet^t to extract and retain such components may 
dictate whether MAP or PA Is the method of choice. Lacking such a decision, a 
researcher may want to examine all solutions In a set bracketted by the MAP 
and PA estimates. Rotational criteria and Interpretablllty may be the basis 

for a final decision. 

Previous studies have examined subsets of these rules under some of the 
conditions examined here. The present study provides co^arlsons across a 
wider variety of situations than previous Investigations. In those a^s 
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where the simulated situations were similar, the results oi Linn (1968), 
Humphreys and MontaneTH (1975), Cattell and Yogel mar (1977), Hakstlan, 
Rogers, and Cattell (1982) and Zwick and Vellcer 09^2) were confirmed and 

#• r 

\ 

expanded. 

Within the limitations imposed by the simfllatlon approach, the results of 
this study, paired with previously reported work, permit some conclusions 
concerning methods of determining the number of components in real data sets. 
There is no evidewe slupporting the continued use of or BART as exclusive, 
primary methods to detenalne the numbed of major coi^onents to retain. These 
methods should no longer be e^loyedl The SCREE procedure has been reported 
to be relatively accurate. This study is consistent with those reports but 
Indicates that the method Is, too variable and too likely to overestimate to be 
employed as the-^ole decision a»thod. However, the SCREE may still be useful 
for Initial estimates or as a conH>lementary a»thod ea^loyed In conjunction 
with PA or MAP. The MAP method was generally quite accurate and consistent 
when the component saturation was high or the coi^onent was defined by more 
than six variables. The MAP did not retain Poorly Defined Coa^onents. The PA 
mathod was also consistently accurate. PA retained PDC's and showed a slight 
tendency to overestlnate. The genera] application of the PA method Is 
difficult to recommend because programs needed for Its application ar-e not 
widely available. Assuming that these problems cari be overcome, either PA or 
MAP are the method of choice, with many situations arising where both should 
be eti^loyed. 
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Footnote 

Some of the natefjal Ircluded in the present paper appeared In the senior 
author's Ph,0, Dissertation. Reprint requests should be sent to Williaw R. 

ZwictC» Counseling Department, Rhode Island Grc^ Health Association, 

* 

530 N. Main Street, Providence, RI 02906. 
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Table 1 



Thg Relationship Between the Niaaber of Substantial Cogpon ent Loadings 
and Eigenvalue Size to MaJor/ Minor and Trivial Cow>otients, 



Variables 
Per 

Cofl^onent 



ElS^nvalue 



Less Than Greater Than 
1.0 KO 



Less 
Than 
3 



Trivial 

(TO 



Winor 



Greater 
Than 
3 



Minor 
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Table 2 

* Hunger of Variables loading Substantially on U c\i} Component under the 
Condition of Unequal Varlables/CowiPQn ent for Different Values of P 
and Numbers of Major C<^onents (MJC). 



Coi^onent 



p 


HJC 


P/MJC 


1 


2 


3 


4 

Pi 


5 


6 


7 


8 


9 


36 


3 


12 


14 


12 


10 




m 


m 






«• 


36 


6 


6 


8 


7 


6 


6 


5 


4 






m 


72 


6 


12 


15 


14 


13 


11 


10 


9 


m 




«• 


72 


9 


8 


12 


11 


10 


9 


8 


7 

• 


6 


5 


4 
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Table 3 



I nterrater rel lability of the Trained Scree Raters with Each Other at 




Saturation. Correct for the Muniber of Raters. 



^ Saturation 



Comp 1 6X1 ty 


.50 


.80 




P « 36 Variables 


1 


.67 


.96 


2 


.96 


.95 


3 


.82 


.98 


4 


.76 


.97 


5 


.65 


.91 


6 


.77 


.77 


P ■ 72 Variables 


1 


.97 


.99 


2 


.80 


.97 


3 


.95 


1.00 


4 


.93 


.81 


5 


.78 


.82 


6 


.75 

• 


.51 



0 
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Table 4 

iteans and Standard Deviations of the Difference from the Population MJC 
at Different Sanple Sizes when P " 36. 



Method 

Sanple Size MAP PA SCREE Kl BA BB BC 

Saturation " .5 

72 d -1.08 -0.05 0.50 8.32 -2.87 -3.92 -3.98 

(sd) (1.68) \(0.70) {1.04) (1.21) (1.10) (0.81) (0.79) 

180 d -1.17 0.13 ^.68 7.30 -1.78 -2.20 -2.27 

(sd) (1.84) (0.39) (0.95) (1.09) (1.26) (0.97) (0.92) 

Saturation • .8 

72 d 0.10 -0.02 0.27 1.77 0.47 -0.48 -0.60 

(sd) (0.30) (0.13) (0.50) (1.59) (2.81) (2.31) (2.30) 

180 d 0.0 0.0 0.23 1.32 1.23 0.68 0.62 

(sd) (0.0) (0.0) (0.52) (1.44) (3.51) (3.27) (3.23) 

— 
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Table S 

Means and Standa rd Deviations of the Difference from the Population MJC 
at -Different Saiaple Sizes ^itfien P " 72. . \ 



Method 

Saniple Size MAP * PA SCREE Kl BA BB BC 

Saturation • .5 

144 d -0.45 0.02 1.16 17.80 -0.43 -1.60 -U73 

(sd) (1.00) (0.57) (1.30) (1.29) 0.16) (1,24) (1.15) 

360 d -0.43 0.07 0.46 15.42 0.40 -0.13 -0.22 

(sd) (1.06) (0.25) (0.79) (1.27) (0.74) (0.43) (0.45^) 

Saturation ■ .8 

144 d 0.02 0.0 0.28 2.97 3.88 2.62 2.50 

(sd) (0.13) (0.0) (0.55) (2.81) (3.64) (2.96) (2.88) 

360 d 0.0 0.0 0.31 2.52 5.03 4;10 3.98 

(sd) (0.0) (0.0) (1.03) (2.59) (4,31) (3.89) (3.78) 
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Table 6 



Heans and Standard Devlatlems of the Difference fro m the Population m 
at Different Mui^ers of Variables Per Coroponent when P " 36. 



Methprd 



P/MJC 




MAP 


PA 


SCREE Kl 


BA 


BB 


BC 


Saturation ■ .5 '^'^ 


6 


d 


-2.27 


0.05 


0.65 7.10 


-1.50 


-2.67 


-2.77 




sd 


(1.88) 


(0./9) 


(1.19) (0.99) 


(1.35) 


(1.58) 


(1.54) 


12 


d 


0.02 


0.03 


0.53 8.52 


-3.15 


-3.45 


-3.48 




(sd) 


(0.13) 


(0.18) 


(0.75) CI. 10) 


(0.44) 


(0.53) 


(0.57) 


■i 


* 






Saturation « .8 








6 


d 


0.08 


0.17 


0.33 1.68 


2.93 


2.17 


2.10 




(sd) 


(0.28) 


(0.13) 


(0.59) (1.70) 


(2.94) 


(2.54) 


(2.54) 


12 


d 


0.92 

\ 

(0.13) 


0.0 


0.17 1.40 


-1.23 


-1.97 


-2.08 




(sd) 


(0.0) 


(0.39) (1.33) 


(1.73) 


(1.24) 


(1.25) 
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Tible 7 , 

Mtans and Standard Devletlcns <?f the Dlfftrence from the Popu lation MJC 
at Different Huiabers of Variables Per Cowponent when P ■ 72. 

(tethod 



P/MJC 




NAP 


PA 


SCREE Kl 


OA 


B8 


BC 










Saturation » .5 








8 


d 


-0.92 


0.07 


1.02 1S.90 


-0.17 


-1.37 


-1.48 




(sd) 


(1.28) 


(0.61) 


(1.22) (1.45) 


(1.21) 


(1.36) 


(1.32) 


12 


d 


0.03 


0.02 


0.60 17.32 


0.13 


0.37 


0.47 




(sd) 


(0.18) 


(0.13) 


(1.00) (1.74) 


(0.85) 


(0.66) 


(0.65) 


Saturation » .8 


8 


d 


0.02 


0.0 


0.21 3.02 


5.15 


4.00 


3.87 




(sd) 


(0.13) 


(0.0) 


(0.74) (3.02) 


(4.56) 


(4.04) 


(3.93) 


12 


d 


0.0 


0.0 


0.38 2.47 


3.77 


2.72 


2.62 




(sd) 


(0.0) 


(0.0) 


(0.89) (2.34) 


(3.27^) 


(2.80) 


(2.73) 
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Table 8 

Iteans and Standard Deviations of the Difference from the Population MJC 
at Different Level s of Pattern Complexity when P « 36 and Saturation « 



Method 



ConQ>1ex1ty 


• 


MAP 


PA 


SCREE 


Kl 


BA 


BB 


BC 




d 


-0,iO 


0.0 


^.38 


7.15 


-0.90 


-1, 


.15 


-1.20 




(sd) 


(0.66) 


(0.32) 


(0.92) 


(1.46) 


(1.29) 


(1< 


.46) 


(1.51) 


2 . 


d 


-O.SO 


-0.10 


0.88 


7.35 








1 /IR 




(sd) 


(0,89) 


(0.45) 


(0.93) 


(1.22) 


(1.3,4) 


(1. 


.54) 


(1.54) 


3 


d 


-0.80 


-0.10 


0.50 


7.30 


-1.20 


-1, 


.40 


-1.55 




(sd) 


(1.06) 


(0.45) 

0 


(1.03) 


(1.03) 


(1.24) 


(1. 


.27) 


(1.39) 


f 

4 


d 


-1.60 


0,0 


0.38 


8.45 


-1.55 


-1 


.85 


-1.90 


1 


(sd) 


(2.09) 


(0.65) 


(0.93) 


(1.10) 


(1.79) 


(1 


.84) 


(1.80) 


5 


d 


-2.05 


-0,25 


0.58 


8.20 












(sd) 


(2.50) 


(0.79) 


(0.96) 


(0.95) 


(1.59) 


(1 


.93) 


(1.89) 


6 


d 


-1.50 


0.20 


0.85 


8.40 


-1.30 


-1 


.70 


-1.75 




sd 


1.96 


0.62 


1.18 


1.10 


1.42 


1 


.66 


1.68 



3 
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Table 9 



Means and Standard Deviations of the Difference from the Population MJC 



at Dlfferer 


It Lev 


§1s of Pattern C 


omplexit, 


y when P 


« 36 and Saturation « 


.8. 


Con^lexlty 








- 


Method 








• NAP 


PA 


SCREE 


K1 


8A 


BB 


BC 


1 


d 


0.0 




n 1 9 


w, 1 9 


0 05 


0.0 


0.0 




(sd) 


(0,0) 






(Q 37i 


(0.22) 


(0.0) 


(0.0) 


2 


d 


0.20 


0«0 


U, tai 


w, 1 9 


0 30 


0.10 


0.0 




(sd) 


(0.41) 


(0.0) 


(0,52) 


(0.37) 


(0.57) 


/ft n \ 




3 


d 


0,0 


0.0 


0,10 


0.10 


0.05 


0,0 


0.0 




(sd) 


(0.0) 


(0.0) 


(0,26) 


(0.31) 


(0.22) 


(0.0) 


(0,0) 


4 


d 


0,0 


0.0 


0,32 


2.90 


3.20 


2.70 


2,50 




(sd) 


(0.0) 


(0.0) 


(0,69) 


(0,85) 


(1.61) 


(1.72) 


(1,88) 


5 


d 


0.05 


0,0 


0,32 


2.85 


4.55 


3.80 


3.65 




(sd) 


(0,22) 


(0.0) 


(0,57) 


(0.74) 


(2.06) 


(2.02) 


(1.81) 


6 


d 


0.05 


-0,05 


0,38 


3.10 


3.45 


3.00 


2.90 




(sd) 


(0.22) 


(0.22) 


(0,54) 


(0.64) 


(1,85) 


(1.92) . 


(1.97) 
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Table 10 

Means and Standard Deviations of the Differencfe from the Population MJC 
at Different Levels of Pattern Coirolexlty when P " 72 and Saturation « 
.5, 



Method 



Con^lexlty 




MAP 


PA 


SCREt 


Ki 


OA 

BA 


Bo 




1 


d 


0.0 


0.0 


0.82 


15.95 


-0.25 


-0.60 


-0.75 




(sd) 


(0.46) 


(0.0) 


(1.09) 


(1.82) 


(0.55) 


,(0.82) 


(0.79) 


2 


d 


-0.05 


0.05 


1.18 


16.00 


-0.15 . 


-U.oU 


-0.09 




(sd) 


(0.22) 


(0.22) 


(1.08) 


(2.10) 


(0.37) 


(0.68) 


(0.67) 


3 


d 


-0.95 


-0.20 


0.40 


15.90 


-0.60 


-1.00 


-1.10 




(sd) 


(1.19) 


(0.41) 


(0.75) 


(1.71) 


(1.31) 


(1.38) 


(1.25) 


4 


d 


-0.10 


0.30 


1.00 


17.15 


-0.45 


-0.95 


-1.10 




(sd) 


(0.45) 


(0.57) 


(1.48) 


(1.46) 


(0,94) 


(1.19) 


(1.25) 


5 


d 


-0.10 


0.20 


0.90 


17.15 


-0.40 


-0.85 


-1.00 




(sd) 


(0.45) 


(0.41) 


(1.11) 


(1.39) 


(9.99) 


(1.22) 


(1.21) 


6 


d 


-1.45 


-0.10 


0.35 


17.50 


-0.70 


-1.20 


-1.25 




(sd) 


(1,60) 


(0.55) 


(0.97) 


(1.24) 


(1.45) 


(1.58) 


(1.55) 
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Table 11 

Means and Standard Deviations of thd Diff erence from the Population I 
at Different levels of Pattern Cosclexlty w hen P « 72 and Saturation 
.8. 



Method 



Cofi?)lex1ty MAP PA SCREE Kl BA 



1 


d 


0.0 


0.0 


0.12 


0.0 


0.05 


0.0 


0.0 




(sd) 


(0.0) 


(0.0) 


(0.32) 


(0.0) 


(C,22) 


(0.0) 


(0.0) 


2 


d 


0.05 


0.0 


0.18 


0.35 


1.70 


0.90 


0.80 




(sd) 


(0.22) 


(0.0) 


(0.41) 


(0.59) 


(1.22) 


(0.91) 


(0.89) 


3 


d 


0.0 


0.0 


0.0 


0.05 


0.05 


0.0 


0.0 




(sd) 


(0.0) 


(0.0) 


(0.0) 


(0.22) 


(0.22) 


(0.0) 


(0.0) 


4 


• d 


0.0 


0.0 


1.05 


5.40 


5.85 


5.30 


5.20 




(sd) 


(0.0) 


(0.0) 


(1.31) 


(0.94) 


(2.03) 


(2.05) 


(1.96) 


5 


d 


0.0 


0.0 


0.40 


5.40 


7.95 


7.10 


6.80 




(sd) 


10.0) _ 


AQM 


_ (0.50) 


(0.82) 


(2.16) 


(2.07) 


(1.99 


6 


d 


0.0 


0.0 


0.0 


5.25 


7.60 


6.85 


6.65 




(sd) 


(0.0) 


(0.0) 


(1.08) 


(0.85) 


(2.76) 


(2.56) 


(2.64) 
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Table 12 

Percent of Each Method's Estimate Deviating a S et Amount from the 
PoDUlatlon MJC when P " 36. 











Method 








Deviation 


r4AP 


PA 


SCREE 


Kl 


BA 


SB 


BC 


Saturation » .5 


j-3 


0.0 


0.0 


4.1 


100.0 


0.0 


0.0 


0.0 


+2 


0.0 


1.7 


16.7 


0.0 


0.0 


0.0 


0.0 


♦1 


0.8 


10.0 


33.3 


0.0 


1.7 


0.0 


0.0 


ID 


59.2 


82.5 


36.7 


0.0 


9.2 


2.5 


1.7 


-1 


11.7 


2.5 


6.7 


0.0 


19.2 


11.7 


10.8 


-2 


9.2 


3.3 


2.5 


0.0 


10.0 


12.5 


12.5 




19.2 


0.0 


0.0 


0.0 


59.9 


^73.3 


75.0 


Saturation " .8 


_+3 


0.0 


0.0 


0.8 


36.7 


25.8 


17.5 


17.5 


+2 


0.0 


0.0 


5.0 


12.5 


1.7 


7.5 


7.5 


+1 


5.0 


0.0 


20.8 


7.5 


14.2 


0.8 


0.8 


±0 


95.0 


99.2 


73.3 


43.3 


26.7 


34.2 


33.3 


-1 


0.0 


0.8 


0.0 


0.0 


6.7 


6.7 


6.7 


-2 


0.0 


0.0 


0.0 


0.0 


6.7 


7.5 


4.2 


_-3 


0.0 


0.0 


0.0 


0.0 


18.3 


25.3 


30.0 
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Table 13 / 

. Percent of Each Method's Estimate Deviating a S^t Anwunt from the 

^^^^^^^^^^^^^^^^^^^^^^^^^^ V 

Population MJC when P « 72. • 



Method 



Deviation 


MAP 


PA 


SCREE 


Kl 


BA 


BB 


BC 


Saturation " .5 


j-3 


O.O 


0.0 


9.2 


100.0 


1.7 


0.0 


0.0 


+2 


O.O 


0.8 


19,1 


0.0 


5.8 


0.8 


0.0 


+1 


2.^ 


8.3 


21.7 


0.0 


10.8 


1.7 


1.7 


10 


75.8 


85.8 


46.7 


0.0 ' 


58.3 


47.5 


41.7 


-1 


6.7 


4.2 


2.5 


0.0 


16.7 


25.8 


31.7 


-2 


6,7 


0.0 


0.8 


0.0 


5.8 


11.4 


10.8 




8.3 


0.0 


0.0 


0.0 


0.8 


12.5 


14.1 


Saturation » .8 


+3 


0.0 


0.0 


5.0 


SO.O 


60.0 


47.5 


45.8 


+2 


O.O 


0.0 


1.7 


0.8 


3.3 


6.3 


9.2 


-♦■1 


0.8 


0.0 


22.5 


5.0 


9.2 


3,3 


3.3 


IP 


99.2 


100.0 


69.2 


44.2 


27.5 


40.8 


41.7 


-1 


0.0 


0.0 


0.0 


0.0 


0.0 


0,0 


0,0 


-2 


O.O 


0.0 


0.8 


0.0 


0.0 


0,0 


0.0 


^ « 3 


0.0 


0.0 


0.8 


0.0 


0.0 


0.0 


0,0 
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